The ProtST framework enhances the pre-training and understanding of protein sequences through biomedical text, constructs the ProtDescribe dataset, designs three pre-training tasks, and supports supervised learning and zero-shot prediction.
Protein Model
Transformers